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Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )KI Responsive to communication(s) filed on 14 July 2010 . 
2a )^ This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-21 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

Claim(s) is/are allowed. 

6) |EI Claim(s) ±2± is/are rejected. 

7) 0 Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 
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Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
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* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

1 . This communication is responsive to the Amendment filed 07/14/2010. 

2. Claims 1-21 are pending in this application. Claims I, 8, 12, 19, 20 and 21 are 
independent claims. In the instant Amendment, claims 1,8, 12, 19, 20 and 21 were amended. 

3. The text of those sections of Title 35, U.S. Code not included in this action can be found 
in a prior Office action. This action made Final. 

Claim Rejections - 35 USC §103 

4. Claims 1, 3-4 10-12, 14-15 and 21, are rejected under 35 U.S.C. 103 (a) as being 
unpatentable over Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of Harper et al. 
("Harper ", US Patent No.: 6,476,817). 

As to claim 1, Fuller discloses an information processing apparatus for handling a 
storage medium storing content data and metadata associated therewith (such as a digital still 
camera or digital video recorder, has an embedded real-time content-based analysis function in 
the capture device to extract metadata from the digital signals. Metadata (descriptive 
information about the digital content) is formatted and stored separately from the content, the 
metadata may be formatted and combined with the digital content in a container format such as 
MPEG-7, QuickTime, or FlashPix, abstract and (such as, storage, image + Metadata, Figure 2 A 
(element 700)), comprising: 

an extracting section for extracting, from said metadata stored on said storage medium 
(such as, In one aspect of the present invention, there is an integrated data and real-time 
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metadata capture system, comprising a digital capture device producing a digital representation 
of one or more forms of media content; a feature extraction engine integrated with the digital 
capture device, the feature extraction engine having a plurality of feature extractors to 
automatically extract metadata in real-time from the digital content simultaneously with the 
capture of the content; and a storage device capable of storing the media content and the 
metadata, wherein selected portions of the metadata are associated with selected portions of the 
media content, col., 4 lines, 24-35), 

wherein the extracting section performs automatic extraction in response to loading the 
storage medium and manual extraction in accordance with a user's operation of selecting the 
metadata to be extracted from a list of selectable metadata (such as, In one aspect of the present 
invention, there is an integrated data and real-time metadata capture system, comprising a 
digital capture device producing a digital representation of one or more forms of media content; 
a feature extraction engine integrated with the digital capture device, the feature extraction 
engine having a plurality of feature extractors to automatically extract metadata in real-time 
from the digital content simultaneously with the capture of the content; and a storage device 
capable of storing the media content and the metadata, wherein selected portions of the 
metadata are associated with selected portions of the media content, col, 4 lines, 24-35, such as, 
plurality of metadata tracks, claim 10)and such as, if the metadata is not combined with the 
digital content, the metadata may require a separate storage or digital interface mechanism. For 
example, a digital video camera that outputs digital component video signals may also have a 
standard RS-232 serial interface for downloading the metadata, paragraph [0050])), 
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Wherein when performing automatic extraction, the extracting section automatically 
searches storage area and storage location for the metadata in the storage medium in response to 
loading the storage medium {such as, automatically extract metadata in real-time from the 
digital content simultaneously with the capture of the content; and a storage device capable of 
storing the media content and the metadata, col., 4 lines, 29-33): and 

wherein the information display unit displays user-selectable metadata in the metadata 
extraction window (such as, information extracted automatically by analyzing the audiovisual 
signal and extracting properties from it, such as key frames, speech-to-text, speaker ID, visual 
properties, face identification/ recognition, optical character recognition, col., I lines, 55-64, 
col., 4 lines, 30-45 and claim 20). 

However Fuller does not explicitly disclose (a) an information display unit for displaying 
the extracted display data and the metadata extraction window onto said information display 
area. 

Harper, from the same field of endeavor discloses (a) an information display unit for 
displaying the extracted display data and the metadata extraction window onto said information 
display area ( such as, Display 18 thus serves as an electrically alterable display or label 
attached to the casing 14 of floppy disk 10, col, 2 line 62-64 and Figure 4). 

It would have been obvious to one of ordinary skill in the art to modify Fuller's teaching 
with the teaching of Harper, because Harper's device eliminates the need of the display driver 
within the storage medium. 
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As to claim 3 , Harper discloses wherein said information display area is exchangeable 
with another information display area. Yamaguchi from the same field of endeavor disclose 
wherein said information display area is exchangeable with another information display area 
(Figures 1 and 4). 

As to claim 4, Harper discloses wherein said information display area is constituted by a 
rewrite sheet (col, 4 line, 50). 

As to claim 7 , Harper discloses wherein said content data include at least video content 
data and said information display unit displays, in said information display area, thumbnail 
image data extracted from said video content data on the basis of said metadata (col, 5 lines, 30- 
55). 

Claims 8 and 12 are similar in scope to claim 1 respectively, and are therefore rejected 
under similar rationale. 

Claims 10 and 14 are similar in scope to claim 3 respectively, and are therefore rejected 
under similar rationale. 

Claims 11 and 15 are similar in scope to claim 4 respectively, and are therefore rejected 
under similar rationale. 

Claim 18 is similar in scope to claim 7, and is therefore rejected under similar rationale. 

Claim 21 is similar in scope to claim 1, and is therefore rejected under similar rationale. 
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5. Claims 2, 5-6, 9, 13, 16 and 17 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of Harper et al. 
("Harper ", US Patent No.: 6,476,817) in further in view of Bloch et al. ("Bloch" Us Patent 
No.: 5,754,102). 

As to claim 2 , Fuller and Harper do not disclose wherein said information display area is 
rewritable. 

However Bloch from the same field of endeavor discloses wherein said information 
display area is rewritable (such as, "electric paper" system is that such a display can be re-written 
upon essentially limitlcssly, col., 4 line, 50). 

It would have been obvious to one of ordinary skill in the art to modify Fuller and 
Harper's teaching with the teaching of Bloch. 

The motivation to combine will provide for adding/deleting data to/from the storage 
media as desired. 

As to claim 5 , Bloch discloses, wherein said information display unit displays, in said 
information display area, said display data by coding at least a part thereof (col, 2 lines, 5-7). 

As to claim 6 , Bloch discloses a metadata editing section for editing said metadata in 
accordance with a processing result of said content data, wherein said extracting section extracts 
said display data also from the edited metadata (col., 3 lines, 23 -36). 
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Claims 9 and 13 are similar in scope to claim 2 respectively, and are therefore rejected 
under similar rationale. 

Claim 16 is similar in scope to claim 5, and is therefore rejected under similar rationale. 
Claim 17 is similar in scope to claim 6, and is therefore rejected under similar rationale. 

6. Claims 19 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Fuller et al. ("Fuller" US Patent No.: 6,833,865) in view of Harper et al. ("Harper ", US 
Patent No.: 6,476,817) in further in view of Bloch et al. ("Bloch" Us Patent No.: 5,754,102) 
and Tehranchi et al. ("Tehranchi" US Patent No.: 6,873,435). 

Claim 19 is similar in scope to claim 1, and is therefore rejected under similar rationale. 

However Fuller in view of Harper and in further in view of Bloch do not disclose 
information display unit displaying said display data as a barcode form by coding a part and a 
thumbnail image automatically. 

Tehranchi from similar field of endeavor discloses information display unit displaying 
said display data as a barcode form by coding a part and a thumbnail image automatically, (such 
as, Bar codes have also been used for tracking and identifying images. In diagnostic imaging, for 
example, patient identification information can be optically encoded directly onto a film such as 
for X-rays, ultrasound, col, 3 lines, 35-40, Figure 1 and 2). 

It would have been obvious to one of ordinary skill in the art to modify Fuller's teaching 
with the teaching of Tehranchi. 
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The motivation to combine to provide, from an image processing apparatus, an output 
print generated from digital data, where encoded metadata identifying a data source and image 
processing variables is coupled to the output print, and to provide a method for image processing 
using such encoded metadata. 

Claim 20 is similar in scope to claim 19, and is therefore rejected under similar rationale. 

Response to Arguments 

1. Applicant's arguments with respect to claims 8, 12 and 19-21 have been fully considered 
but they are not persuasive. 

Applicant argues (a) Fuller in view of Harper does not disclose "wherein the extraction 
section performs automatic extraction in response to loading the storage medium and..." as 
recited in claim 1 . 

The Examiner disagrees for the following reasons. 

Per (a) Fuller in view of Harper disclose "wherein the extraction section performs 
automatic extraction ..." (such as, In one aspect of the present invention, there is an integrated 
data and real-time metadata capture system, comprising a digital capture device producing a 
digital representation of one or more forms of media content; a feature extraction engine 
integrated with the digital capture device, the feature extraction engine having a plurality of 
feature extractors to automatically extract metadata in real-time from the digital content 
simultaneously with the capture of the content; and a storage device capable of storing the media 
content and the metadata, wherein selected portions of the metadata are associated with selected 
portions of the media content, col, 4 lines, 24-35) in response to loading the storage medium (if 
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the metadata is not combined with the digital content, the metadata may require a separate 
storage or digital interface mechanism. For example, a digital video camera that outputs digital 
component video signals may also have a standard RS-232 serial interface for downloading the 
metadata, paragraph [0050]). 

Conclusion 

8. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Inquiry 

9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to MESEKER TAKELE whose telephone number is (571)270- 
1653. The examiner can normally be reached on Monday - Friday 7:30AM- 5:00PM est. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, William Bashore can be reached on (571) 272-4088. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Meseker Takele/ 
Examiner, Art Unit 2175 



/WILLIAM L. BASHORE/ 

Supervisory Patent Examiner, Art Unit 2175 



